System and method for real-time audiovisual interaction with a target location

ABSTRACT

Systems and methods of real-time audiovisual interaction with a target location includes receiving an identification of a target location. The identification can be received at a processor of a server from an electronic device of an end-user. A request can be transmitted for a video feed associated with the target location. For example, the video feed can be a live video feed of an interior of the target location or a video chat with a representative of the target location. In response to receiving the video feed, the video feed can be transmitted to the electronic device of the end-user. When audiovisual communication is established, a user can view different aspects of a target location, for example the capacity of a restaurant or speak directly with a representative of a clothing store to see if they have a specific item in the users&#39; size.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/559,386, filed Sep. 3, 2019, which claims priority to U.S. patentapplication Ser. No. 13/627,924, filed Sep. 26, 2012, which are herebyincorporated by reference for all purposes as if fully set forth herein.

FIELD OF TECHNOLOGY

The present disclosure relates generally to electronic maps, and morespecifically, to a system and method of real-time interaction with atarget location.

BACKGROUND

Electronic devices, tablet computers and smart phones, enabled for mediaplayback allow the user of the electronic device to watch videos, listento music, watch and listen to streamed media, listen to a radio station,watch movies, watch animations, play video games, or otherwise listen,view, or interact with media content. Additionally, electronic devicescan also be enabled to access geographical location information relatingto the current location of the electronic device. Conventional systemsand methods of determining the location of an electronic devicetypically determine an approximate location of the electronic device.For example, GPS systems identify location of an electronic device byGPS coordinates that are indicative of an approximate longitude andlatitude of the electronic device. Triangulation of the location of anelectronic device with respect to cellular towers also identifies anapproximate location of the electronic device. In another conventionalsystem, which determines an electronic device's location using WirelessFidelity (Wi-Fi) access points, when an electronic device is determinedas being visible to the device or accessible by the device, the locationassociated with the MAC address (typically longitude and latitudecoordinates) of the Wi-Fi hotspot is approximated as the location of theelectronic device.

These electronic devices have provided users with multimedia experienceswhich have grown more integral in our everyday lives. While conventionaltechnologies provide both multimedia and location determination, such asDabble™, Foursquare™, Instagram™, Facebook™, and Twitter™ etc., none ofthese applications provide the user with live or real-time data withwhich to analyze a target location and remotely predict their ownpersonal user experience. Traditional technologies rely oncrowd-sourcing the task of acquiring information for their users, fromtheir other users.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the features of the disclosurecan be obtained, a more particular description of the principles brieflydescribed above will be rendered by reference to specific examplesthereof which are illustrated in the appended drawings. Understandingthat these drawings depict only example embodiments of the disclosureand are not therefore to be considered to be limiting of its scope, theprinciples herein are described and explained with additionalspecificity and detail through the use of the accompanying drawings inwhich:

FIG. 1 is a block diagram of a system for real-time interaction with atarget location including an electronic device interacting, via alocation module and a data network connection to a communicationnetwork, with a plurality of target locations that each have anassociated electronic device, in accordance with an exampleimplementation of the present technology;

FIG. 2 is a flow diagram of a method of real-time interaction with atarget location, in accordance with an example implementation of thepresent technology;

FIG. 3a is an illustration of an electronic device engaging in real-timeinteraction with a target location, in accordance with an exampleimplementation of the present technology;

FIG. 3b is a block diagram of an example electronic device, inaccordance with an example implementation of the present technology;

FIG. 4a is an example front view of an electronic device illustrating anexample user interface (UI) of a system configured for real-timeinteraction with a target location, in accordance with an exampleimplementation of the present technology;

FIG. 4b is an example of a rear view of an electronic device configuredfor real-time interaction with a target location, in accordance with anexample implementation of the present technology;

FIG. 5 is an example screenshot of a UI for determining a targetlocation for real-time interaction displayed on an electronic device, inaccordance with an example implementation of the present technology,illustrating the main menu with selectable options;

FIG. 6 is an example screenshot of a UI for determining a targetlocation for real-time interaction that is displayed on an electronicdevice, in accordance with an example implementation of the presenttechnology, illustrating the selection of a target location from amap-view;

FIG. 7 is an example screenshot of a UI for determining a targetlocation for real-time interaction displayed on an electronic device, inaccordance with an example implementation of the present technology,illustrating a street-view of the selected target location selected inFIG. 6;

FIG. 8 is an example screenshot of a UI for determining a targetlocation for real-time interaction displayed on an electronic device, inaccordance with an example implementation of the present technology,illustrating a real-time interaction with the selected target locationselected in FIGS. 6 and 7, where the real-time interaction is a videofeed from the selected target location;

FIG. 9 is an example screenshot of a UI for determining a targetlocation for real-time interaction displayed on an electronic device, inaccordance with an example implementation of the present technology,illustrating real-time interaction with the selected target locationselected in FIGS. 6 and 7, where the real-time interaction is areal-time chat; and

FIG. 10 is a screenshot of a UI for determining a target location forreal-time interaction displayed on an electronic device, in accordancewith an example implementation of the present technology, illustrating aplurality of options for real-time interaction with a selected targetlocation.

DETAILED DESCRIPTION

Various examples of the disclosure are discussed in detail below. Whilespecific implementations are discussed, it should be understood thatthis is done for illustration purposes only. The examples arenon-limiting and it will be understood that other components andconfigurations can be used without parting from the scope of thedisclosure.

Several definitions that apply throughout this disclosure will now bepresented. The word “coupled” is defined as connected, whether directlyor indirectly through intervening components, and is not necessarilylimited to physical connections. The term “communicatively coupled” isdefined as connected whether directly or indirectly through interveningcomponents, is not necessarily limited to a physical connection, andallows for the transfer of data.

“Electronic devices” can include, but are not limited to, portablecommunication devices, mobile communication devices, mobile computers,smartphones, computing pads, tablet computers, personal computers,desktop computers, laptop computers, netbooks, servers, routers, set-topphones, or other electronic devices capable of at least accepting data,transmitting data, and executing commands.

“Highlighting” can include, but is not limited to, changing the color ofthe graphical item, changing the font or appearance of the graphicalitem, applying a background color to the graphical item, superimposing ablock of semi-transparent color over the graphical item, placing aborder around the graphical item, enlarging the graphical item ascompared to other graphical items proximate to the highlighted graphicalitem, or other similar and known methods of highlighting graphical itemsor text items display on a display screen.

“Memory” can include, but in not limited to, transitory memory andnon-transitory memory. For example, non-transitory memory can beimplemented as Random Access Memory (RAM), Read-Only Memory (ROM),flash, ferromagnetic, phase-change memory, and other non-transitorymemory technologies.

“Location aware” can include, but in not limited to, the ability of anelectronic device to passively or actively determine its currentgeographical location. For example, an electronic device can determineits current geographical location locally by using such technologies asReal-Time Locating System (RTLS), Wireless Personal Area Network (WPAN),Wireless or Wired Local Area Network (LAN) or Digital Enhanced CordlessTelecommunications (DECT) for determining the location of the electronicdevice. An electronic device can determine its current geographicallocation regionally by using technologies such as 3rd GenerationPartnership Project (3GPP), Global System for Mobile Communication (GSM)or Long Term Evolution (LTE), or other radio access technologies todetermine the electronic devices location. An electronic device candetermine its current geographical location globally by usingtechnologies such as Global Positioning System (GPS) or Galileo™. Whilethe above describes specific examples of technologies used to configurean electronic device for location-awareness, it will be appreciated thatany other suitable technology by which an electronic device candetermine the electronic device's location or determine a relativelocation of the electronic device can be implemented.

A “target location” can include, but is not limited to, a specificlocation that is discoverable via an electronic device. The targetlocation can have a similar electronic device, which it cancommunicatively couple with the electronic device initiating thecommunication. The target location's electronic device can have at leastsome capabilities similar to the initiating electronic device. Targetlocations can include businesses, restaurants, cafes, hotels, clothingstores, shoe stores, electronics stores, department stores, boutiqueshops, comedy clubs, sporting venues, attractions, points of interests,buildings, offices, or any type of location configured to communicatewith at least a remote electronic device (for example, over acommunication network).

“Media” can include, but is not limited to, visual, audio, or combinedvisual and audio data which can be outputted by an electronic device.Additionally, “media” refers to transitory or non-transitory media.Examples of media can include, but are not limited to, video files,audio tracks, multimedia files, music files, songs, movies, animations,graphics, MIDI files, or any other media file which can be played oroutputted by an electronic device.

The present disclosure provides systems and methods for real-timeinteraction with a target location, such as a restaurant. In one exampleembodiment, the present disclosure provides for communication between anelectronic device and a target location. The electronic device can belocated remotely from the target location. The system and method caninclude a User Interface (UI) (for example, a mobile applicationexecutable on the electronic device, a web-based application, or anyother user interface executable on an electronic device), a locationmodule (for example, GPS), a communication link, and one or more audio,video, or both audio and video devices. The electronic device can beconfigured to respond to requests (for example, user-directed queries)to interact with a target location. In a non-limiting example, therequest for interaction can be a request for a video feed. In such anexample, after a video feed is selected the video feed can be streamedto the electronic device. The video feed can include a static live-feedfrom one or more cameras located throughout the target location (forexample, a business), video captured by an electronic device, displaydevices that allow for video-chatting, video conferencing, orteleconferencing with a representative of the target location, orpre-recorded video files. In other embodiments, the real-timeinteraction with the target location can include receiving livestatistics about available seating, availability of items, anticipatedwait-time, or other information associated with the target location.

FIG. 1 is a block diagram representing an electronic device interactingwith a target location that has video capture devices (not shown). Forexample, in FIG. 1, the electronic device 101 is interacting with thetarget location 102 via data connection to a communication network 105.In FIG. 1, the electronic device 101 can connect to a communicationnetwork 105 via communication module 107. For example, the communicationmodule 107 can include one or more of a mobile telecommunicationsmodule, a cellular communication module, a Wireless Fidelity (Wi-Fi)module, Ethernet or landline module, or any other module, which allowsfor the communication between the electronic device and target locationremote from the electronic device. When the electronic device 101connects to the communication network, data and location-awarenessinformation can be transmitted over the communications network 105 tothe electronic device 101. The communications network 105 can includebut is not limited to the Internet, a telephone network, a wirelessnetwork, Bluetooth™, a near-field communication network, or ashort-range wireless network. Location-awareness information can also bedetermined by location module 106. For example, the location informationcan be determined using one or more satellites 104 to determine andacquire the geographical coordinates of the electronic device 101. Theplurality of target location 102 can also connect to a communicationnetwork 105 via communications module 107 or location module 106 inorder to determine the current location of an electronic deviceassociated with the target location. The current location of theelectronic device 101 can be stored locally on the electronic device101, on a server 103, or both locally on the electronic device 101 andthe server 103. The server 103 can store specific information in regardsto the target locations. For example, information such as the targetlocation's name, address, operating hours, telephone number, currentlocation, and communication options. The server 103 can also receive andrespond to requests from the electronic device 101. For example, theserequests can include requests for searches for target locations,requests to coupling with a target location, requests for video feeds,requests to video chat or requests for any other information from targetlocations. While the system illustrated in FIG. 1 includes a server 103,those of ordinary skill in the art will appreciate that electronicdevice 101 can transmit requests to the electronic device associatedwith the target location and receive information from the electronicdevice associated with the target location without communicating with aserver. For example, satellite 104 can be a GPS satellite that allows anelectronic device 101 to be location-aware so that the electronic device101 can search (for example, via server 103) for proximal targetlocations 102 a-n within a predetermined distance of the currentlocation of the electronic device 101.

Examples of electronic devices 101 and 102 for real-time audiovisualinteraction with a target location will now be described in more detail.An electronic device can be defined as any device that is capable of atleast accepting data, transmitting data, and executing commands. Exampleelectronic devices can include, but are not limited to, portablecommunication devices, mobile communication devices, mobile computers,smartphones, computing pads, tablet computers, personal computers,desktop computers, laptop computers, netbooks, servers, routers, set-topphones, or other electronic devices capable of at least accepting data,transmitting data, and executing commands. Electronic devices 101 and102 can include a memory (for example high-speed random access memory,non-volatile memory, flash memory, solid-state memory), one or morecentral processing units (CPU, which for example can run or executevarious software programs and/or sets of instructions stored in memoryto perform various functions for the electronic devices 101 and 102), adisplay (for example, a touch sensitive display or touchscreen), acommunication module (for example, radio frequency (RF) circuitry orglobal positioning system), an image module (for example, a still imagecamera, a moving image camera), audio circuitry (for example, a speaker,a microphone, a headset jack), a power system (for example, a battery,alternating current (AC) adapter), software components (for example anoperating system such as Windows, Linux OSX, UNIX). It should beappreciated that devices 101 and 102 are only one example of anelectronic device 101 and 102, and that electronic devices 101 and 102can have more or fewer components than shown, can combine two orcomponents, or can have a different configuration or arrangement of thecomponents. The various components show in FIG. 1 and FIG. 3 can beimplemented in hardware, software or a combination of both hardware asoftware, including one or more signal processing and applicationspecific integrated circuits.

A server 103 for real time audiovisual interaction with a targetlocation will now be described in more detail. A server can be definedas any device that is capable of running one or more services that servethe needs of other computers or clients on the same communicationsnetwork. Examples of servers are, web server, communications server,database server, name server, proxy server, print server, and in thisspecific environment an application server. An application server is aserver dedicated to running certain software applications (for example,a real-time audiovisual interaction server). A server can have at leastone of a memory (for example high-speed random access memory,non-volatile memory, flash memory, solid-state memory, hard disks), oneor more central processing units (CPU, which for example can run orexecute various software programs and/or sets of instructions stored inmemory to perform various functions for the server 103), a communicationmodule (for example, radio frequency (RF) circuitry or globalpositioning system), a power system (for example, a battery, alternatingcurrent (AC) adapter), software components (for example an operatingsystem such as Windows, Linux, OSX, UNIX and an application such as areal-time audiovisual interaction application). It should be appreciatedthat server 103 is only one example of a server 103, and that server 103can have more or fewer components than shown, can combine two orcomponents, or can have a different configuration or arrangement of thecomponents

FIG. 2 is a flow chart of an example method of real-time interactionbetween a user's electronic device and an electronic device associatedwith a target location. The method 200 illustrated in FIG. 2 is providedby way of example, as there are a variety of ways to carry out themethod. Additionally, while the example method is illustrated with aparticular order of steps, those of ordinary skill in the art willappreciate that FIG. 2 and the steps illustrated therein can be executedin any order that accomplishes the technical advantages of the presentdisclosure and can include fewer or more steps than illustrated.

Each block shown in FIG. 2 represents one or more processes, methods orsubroutines, carried out in example method. The steps illustrated inFIG. 2 can be implemented in a system including an electronic device101, a server 103 and an electronic device associated with a targetlocation 102. For example, a smartphone, an electronic tablet, or anyother electronic device capable of at least accepting data, transmittingdata, and executing commands. Each block shown in FIG. 2 can be carriedout by electronic device 101 and electronic device associated with atarget location 102 illustrated in FIG. 1. The flow chart illustrated inFIG. 2 will be described in relation to and make reference to theelectronic device 101, server 103 and an electronic device associatedwith a target location 102 in FIG. 1.

Method 200 can begin at block 210. At block 210, a request is receivedat the server 103 from electronic device 101 to locate one or more of aproximal target location 102. Electronic device 101 can also send itscurrent physical location to server 103. When server 103 receives therequest, it can compare the data in the request with data previouslystored on server 103 from target locations 102. In one exampleimplementation, the current location of the electronic device 101 can bedetermined based on data received from a location module 106 coupled tothe electronic device 101. For example, the electronic device cancomprise a location module 106, such as a Global Position System (GPS).The GPS 106 can determine the geographical coordinates of the currentlocation of the electronic device 101 via satellite 104. In anotherembodiment, the location module can be a communication module 107 of theelectronic device 101. For example, communication module 107 can be acellular antenna. A cellular antenna 107 can use a triangulation methodto determine the location of the electronic device 101. For example,cellular towers proximate the electronic device 101 can be detected bythe cellular antenna and can be utilized to determine the currentposition of the electronic device 101. While a GPS or triangulationmethod can be implemented to determine the position of the electronicdevice, other methods of determining the location of an electronicdevice 101 can be implemented. After the request is sent at block 210,the method can proceed to block 220.

At block 220, server 103 transmits via communication network 105,information associated with one or more of a proximal target locationsthat are available for communication with electronic device 101. Server103 compares the data received at block 210, with data previously storedon Server 103. The results of the comparison is information of one ormore of a proximal target locations. If there are no results from thecomparison, than server 103 transmits to electronic device 101 astatement that no results were found. The information associated withone or more of proximal target locations can be formatted, by anapplication, for display on the electronic device 101. Such formats caninclude, but are not limited to: a list, a list with descriptions, amap, a map showing the electronic device's location along with thelocations of the target locations, or a street view of targetedlocations. After server 103 transmits the information in regards to aone or more of a proximal target locations 102 a-n that are availablefor communication at block 220, the method can proceed to block 230.

At block 230, server 103 can receive a target location selected fromelectronic device 101. For example, the target location can be selectedby receiving an input, at the electronic device 101 (for example, at atouchscreen), where the input is associated with informationcorresponding to a target location displayed on the touchscreen of theelectronic device 101. In response to the received selection, theelectronic device 101 can request to communicatively couple with anelectronic device located at the selected target location via server 103or communication network 105. After the electronic device 101 iscommunicatively coupled with the selected target location at block 230,the method can proceed to block 240.

At block 240, one or more selectable options associated with theselected target location are transmitted from server 103 to be displayedat the electronic device 101. The one or more selectable options caninclude, but are not limited to, options for retrieving a static livevideo of the selected target location (for example, an interior of theselected target location), conducting a live chat with a representativeof the selected target location, retrieving live data associated withthe selected target location, retrieving live statistics associated withthe selected target location, retrieving a pre-recorded video associatedwith the selected target location, any combination thereof, or any otherretrieving any other information associated with the target location.After the one or more selectable options are displayed at block 240, themethod can proceed to block 250.

At block 250, a selection of one of the one or more options can bereceived. For example, the server can receive a signal or an inputcorresponding to a selection of one of the one or more options displayedat the electronic device 101. In at least one implementation, an optioncorresponding to a pre-recorded video can be received. In response,server 103 can stream the video to the electronic device 101. Forexample, the streamed video can be a locally-hosted pre-recorded videothat includes detailed information associated with the target location.In another implementation, locally-hosted, externally-hosted, or bothlocally- and externally-hosted video files filmed at the target locationcan be streamed to the electronic device 101, via server 103. In atleast some implementations, the videos can be recorded by othercustomers of located at the target location. The videos can provideinformation which can be of interest to the use of the electronic device101 (for example, in deciding whether to visit the target location 103).Such information can include what type of food is served at the targetlocation, how capable the location is of hosting an event, anavailability for dining reservations, a type of décor, or any otherinformation associated with the target location 102. After the server103 receives a selected request for data communication at block 250, themethod can proceed to block 260.

At block 260, server 103 transmits to electronic device 101, via a datacommunication network, data representative of the selected video or datastream. In at least one implementation, server 103 transmits a videochat from a representative of target location 102 to electronic device101. In another implementation, server 103 can receive a video chatresponse from electronic device 101. In another implementation, thevideo stream transmitted can be from a stationary video camera. In oneimplementation, server 103 receives commands to control the stationary avideo camera at the target location by electronic device 101. In anotherimplementation, server 103 can transmit selectable icons which aredisplayed in combination with the video feed at electronic device 101(for example, the icons can be overlaid on the live video, displayedproximate to or adjacent to the live video, or displayed with the livevideo).

FIG. 3a is an illustration representing an example electronic deviceinteracting with a target location that has an image module capable ofcapturing real-time video. Electronic device 301 can request, through acommunication network 305, to receive a data stream from the electronicdevice associated with the target location 302. A GPS satellite 304 anda communication network 305 can be utilized to provide locationinformation to the electronic devices 301 and the electronic devicesassociated with target locations 302. Receiving location informationfrom one or more GPS satellites or communication networks can bebeneficial where the target locations are moving target locations, suchas a food truck, pop-up store or a traveling location.

FIG. 3a also illustrates an example electronic device 301 (of which ablock diagram is illustrated in FIG. 3b ). Electronic device 301 caninclude, but is not limited to, a front image module 308, a rear imagemodule 317, a touch sensitive display 309, a communication module 306,and a location module 306. The front image module 308 (for example, acamera module) can capture still or moving images from the front of theelectronic device 301. The rear image module 317 can capture still ormoving images from the rear of the electronic device 301. The touchsensitive display or touchscreen 309 can be utilized as an input device.For example, the touchscreen 309 can detect contact and any movement orbreaking thereof, indicating the entry of an input. For example, thetouchscreen 309 can detect inputs via capacitive, resistive, infrared,surface acoustic wave technologies, or any other technology by whichinputs can be detected an input at an electronic device 301. Thelocation module 306 can be configured to determine or detect thelocation of the electronic device 301. For example, the location module306 can be a GPS module. The location information determined by thelocation module 306 can be utilized by various applications executed bythe electronic device 301. For example, such applications can includelocation based mapping and navigation, checking-in applications such asFacebook™ and Foursquare™, image- and location-based applications suchas Dabble™ or Instagram™, or any other application which utilizes thelocation of the electronic device 301. Additionally, the locationinformation can be utilized for an application configured to execute anyof the methods of real-time interaction with a target location describedherein. The electronic device 301 illustrated in FIGS. 3a and 3b canalso include one or more central processing units (CPU) 310, a memory311 (which can include one or more computer readable storage mediums), amicrophone 312 for audio input, an earphone speaker for outputtingaudio, a speaker for outputting audio, an earphone jack 318 for couplinga headphone or headset to which audio is output, or any other componentfor processing, transmitting, or receiving information.

FIG. 3a illustrates example target locations 302 a and 302 b. Forexample, in FIG. 3a , the target locations can include a hotel 302 a anda shoe store 302 b. Each of these target locations (302 a and 302 b) caninclude image module devices from which real-time interaction data canbe transmitted to and received from electronic devices 301 remote fromthe target location. For example, such an image module devices caninclude a still image camera; a moving image camera; a wearable movingimage camera; a self flying or hovering moving image camera; asmartphone, a tablet computer, personal digital assistant, a laptopcomputer or any other electronic device with a moving image camera andmicrophone; or any of the aforementioned descriptions of the varioustechnologies encompassed by electronic device 301. Target locations (302a and 302 b), can include static moving image cameras positioned orlocated within or at the respective target location (302 a and 302 b);controllable moving image cameras locally controllable at the respectivetarget location (302 a and 302 b) (for example, a helmet camera attachedto a representative); remotely controllable moving image cameracontrollable by an electronic device remote from the respective targetlocation (302 a and 302 b) (for example, a moving image camera that canpan a target location or a moving image camera mounted on a trolley orvehicle that can be navigated around the target location); Both locallyand remotely controllable moving image camera; electronic devices bywhich representatives of the respective target location (302 a and 302b) can video chat face-to-face with remotely located electronic devices;electronic devices which are configured to allow remotely-locatedelectronic devices to view products located at the respective targetlocation (302 a and 302 b); electronic devices configured to interactwith one or more remotely-located electronic devices to provide a guideor tour of the respective target location (302 a and 302 b) (forexample, to provide a tour or guide of: prospective hotel rooms,prospective tables, restaurant décor, or individual products); locallyor remotely-located computer-storage mediums storing pre-recorded videoto be transmitted to a user's electronic device (for example, via theinternet); one or more remote-controlled video capture devices, whichcan be remotely or locally controlled, by the target location of theelectronic device of a user requesting interaction with the targetlocation, to move about the target location (302 a and 302 b)

FIG. 4a illustrates the front view of an example electronic device 401.Electronic device 401 can include a touchscreen 409, a user interface420 and one or more selectable applications 415 with an icon 416highlighted for selection. For example, the one or more selectableapplications can be presented in a list. Each of the one or moreselectable applications can be represented by an icon. The icons can beselected via user inputs received at the electronic device. For example,such user inputs can include double or single clicking, gaze tracking,motion inputs, audible inputs, voice command, tap inputs at the touchscreen, stylus inputs, key pressings, or any other input which can bereceived by the electronic device to indicate that a selection has beenmade. When an application is selected, the icon corresponding to theselected application can be highlighted, thereby designating ordistinguishing the selected application from the remaining applicationspresented in the list of applications. The example electronic device 401can include an earpiece speaker 413, a front image module 408, amicrophone 412, and earphone jack 418. The earpiece speaker 413 canproduce audio for private listening. The front image module 408 can beconfigured to capture video of the end-user for video chat purposes. Themicrophone 412 can be configured to capture audio such that the capturedaudio can be transmitted to the target location during real-timeinteraction between the target location and the electronic device. Theearphone jack 418 can be configured to couple headphones, a headset, aBluetooth™ headset, or other audio output devices. User Interface 420displays one or more user-selectable applications 415, including ahighlighted application 416 that represents an application configured toexecute the presently disclosed method of real-time interaction with atarget location. In another implementation, the real-time interactionwith a target location can be incorporated with existing applicationsexecutable on the electronic device. For example, real-time interactionwith a target location can be incorporated with an existing mapsapplication, a street view map application, an augmented realityapplication, a social networking application, a website of a targetlocation, or any other application by which an electronic device cansearch for and receive information associated with target locations

FIG. 4b illustrates the rear view of an example electronic device 401.Electronic device 401 can include a rear image module 417. The rearimage module 417 can be configured to capture video for use in thestreet view application in which an example can be seen in FIG. 7.Electronic device 401 can also include rear speakers 414 for producingaudio.

After a user executes the highlighted application 416 shown in FIG. 4a ,the application 416 is displayed on the touchscreen 409 of theelectronic device 401. An example screenshot of this can be seen in FIG.5. In FIG. 5, when highlighted application 416 is initiated, a UserInterface 520 including a title bar with logo 521 associated with thehighlighted application can be displayed on the touchscreen 509. Alsoillustrated in FIG. 5, UI 520 can include one or more selectable options522, 523, 524, 525, 526, and 527. The selectable options can include asearch bar 522, a nearby option 523, a maps option 524, a street viewoption 525, a favorites option 526 and a settings option 527. The searchbar 522 can accept search terms from the user of electronic device 501for searching for specific target locations. The nearby option 523 canbe selected to search for target locations proximate or within apredetermined distance from the current location of the electronicdevice. In one example, nearby option 523 can have a defaultpredetermined distance setting. In another example, the predetermineddistance can be a user-defined setting in the settings option 527. Themaps option 524 allows a user to view nearby target locationsgraphically on a local area map. The Street View option 525 would allowfor the user to explore an actual view of the street, determined bytheir location, on the screen of the electronic device, utilizing therear image module (not shown) of the electronic device 501. Shortcut 526links to the individual user's favorites. Application settings 527 allowfor specified application settings to be changed, for example thedistance of the default proximity.

In FIG. 6, the Maps option 524 (shown in FIG. 5) has been selected, andin response a map 629 is displayed on the display of the electronicdevice 601. The map 629 can display the user's current location and thearea surrounding the user's location, a selected target location, or theselected target location and the user's current location with respect tothe selected target location. In FIG. 6, the map 629 illustrates thecurrent location of the user's electronic device with respect to aselected target location (Leroy's Restaurant). The current location ofthe electronic device (which can be representative of the currentlocation of the user) can be represented on the map by a star icon, asillustrated, but those of ordinary skill in the art will appreciate thatthe current location can be identified by a circle, an arrow indicatinga direction the user is facing, a customizable icon that is selected bythe user, a flag, or any other graphical item or text which can identifythe current location of the user's electronic device. In at least oneexample, the map 629 can display the current location of the user'selectronic device and targeted locations 628 within a predetermineddistance from the current location of the user's electronic device. Asdiscussed above, the target location 628 Leroy's Restaurant has beenselected. In response to selecting the icon 628 representing Leroy'sRestaurant, information associated with Leroy's Restaurant can bedisplayed on the map. For example, the information can be display in apop-up window, in a text box overlaid on the map, in a frame adjacent tothe map, or elsewhere on the UI 620. The information can include detailsdescribing the building, establishment, business, attraction, or venueassociated with the selected target location. For example, in FIG. 6,the information can include one or more of: information about the targetlocation 630 (for example, name, address, business hours, phone number),a non-interactive video feed 631, available non-interactive video feedoptions 632, live data 636 (for example seating availability, waitingtime) or any other information associated with the target location. Inone example, the non-interactive video feeds 632 can include an opentable view, a bar view, and a kitchen view. The open table can showavailable tables for booking a reservation. The bar view can be areal-time video feed of the bar so the user can see the atmosphere. Therequest view can display a specific view from Leroy's Restaurantspecified by the user. In other words, the request view can provide acustomer-specific or a customized view of the target location. Othervideo feeds can include views of bar, a dining room, a kitchen,available products, hotel lobbies, or restaurant seating The UI 620 canalso include an interactive options menu 633. The interactive optionsmenu 633 can include options for interactive video communication 634(for example, video chatting with an individual, such as customerservice representatives, maître d', employees, managers, or controllinga mobile camera). By selecting a specific individual 634 to communicatewith the user is then audio and visually connected to that specificindividual, (for example, if the user selected Maitre'd 634, they couldask about the dress code of the target location or to get their name ona waiting list). The information associated with the target location canalso include live statistical information 636. For example, livestatistical information can include average wait time and seatingavailability. The live statistical information can be updated inreal-time. In FIG. 6, the live statistical information 636 can indicatethat Leroy's is currently has eight available seats for lunch and sevenopen seats at the bar. Based on such information, the user can request,via the user's electronic device, a reservation of a seat for lunch. Theavailability of seats can be determined by linking or synchronizing acomputer system associated with the target location and the internet ora server that communicatively couples the user's electronic device andthe target location).

FIG. 7 illustrates a User Interface 720 that can be displayed on anelectronic device 701 in response to a selection of the Street Viewoption 525 illustrated in FIG. 5. When the Street View option isselected, a first-person view (for example, a virtual reality view or aview taken from the perspective of the user as if the user is physicallystanding in the street) of the user's current location can be displayed.Street view can operate by using a preexisting photograph of the streetif it is available. If a preexisting photograph of the street at thecurrent location is not available the user can use the rear image moduleand touch screen to implement an “augmented reality” Street View. Inaddition to the street view of the user's current location, availabletarget locations can be included. The available target locations can beidentified by selectable markers 728 (for example, Barkly Hotel, Shoes,Leroy's and Village Bell Bar are all shown to have selectable markers728). If a marker is selected, an information box 735 can be displayedwith, adjacent to, on top of, overlaid or in place of the street view(for example, the Shoes marker 728 is selected and information box 735is displayed as a pop-up box adjacent to Shoes marker 728 via UI 720).The information box 735 can include detailed information associated withthe target location corresponding to the marker 728 selected. Forexample, the information box 735 can include information for initiatingnon-interactive videos, communication via video chat, live statistics,target location name, target location address, target location phonenumber, and target location rating. The target location ratings can beintegrated in application 416 (shown in FIG. 4) or can be third-partyratings software (for example, tripadvisor.com or booking.com). Thetarget location ratings can enable a user to view or leave a review orfeedback (for example, written or video review) of their experience witha target location, view or leaving ratings (for example, a star rating)of a target location, or discuss a target location via an online forum.The target location ratings can enable a user to make a more educateddecision when selecting a target location for an audiovisualinteraction. The UI 720 also includes a compass 737 (for example,compass 737 can tell a user which direction they are currently facingand which direction they need to walk in order to get arrive at thetarget location).

FIG. 8 illustrates a UI 820 that can be displayed on an electronicdevice 801 when the open table view 632 is selected from the UIillustrated in FIG. 6. FIG. 8 can show a live feed of a top down view ofthe dining room from a static camera located in Leroy's. In anotherexample this camera could be located in any location in any type oftarget location: conference, stadium, top of skyscraper, or the insideof a store. The user is currently viewing the highlighted dining roomvideo feed 843. A user can select different video feeds 842 by usingvideo selection box 841 (for example, a kitchen video feed and entry wayvideo feed). The open table view can have virtual icons 828 which can beoverlaid actual tables viewed from the dining room video feed 843 (forexample, tables currently available or available at a later time canhave a selectable icon 828). If an icon is selected, an information box835 can be displayed with, adjacent to, on top of, overlaid or in placeof the open table view (for example, the Table 4 icon 828 is selectedand information box 835 is displayed as a pop-up box adjacent to theTable 4 icon 828 via UI 820). The information box 835 can include thetype and seating capacity of the table, along with live data correlatingto reservations, such as the option of reserving a table for now, orreserving a table for a later point of time. The user can also askquestions of either a live representative at the establishment oranother answering entity (for example an automated response system), byusing text box 846 and send button 847.

FIG. 9 illustrates a UI 920 that can display, on an electronic device901, a video chat when selected from information box 735 in Street Viewillustrated in FIG. 7. When the communicate option is selected, a livechat with a customer representative at a target location can bedisplayed. FIG. 9 can show a video chat with a representative using anelectronic device (not shown) associated with the target location (forexample, the representative could be using a handheld device, tabletcomputer, smartphone, a stationary camera attached to a computer, or anydevice with audio, video and transmitting, receiving capabilities). Theuser communicated with the representative of the target location usingmicrophone 912, speakers 914 and front image module 908. The user canalso have a private video chat by connecting earphones to electronicdevice 901 via earphone jack 918. The user, while video chatting, canget more information on available products and services offered at thetarget location (for example, the representative can show the useravailable product and demonstrate how they work, they can give the usera tour of a hotel room, or they can speak with them about reservations).UI 920, can display one or more of the following: a Title bar 948, whichcan details of the representative in the video chat (for example, nameof the representative or target location the user is video chatting),the representative 949 with whom the user is video chatting, video ofthe user 950 via front image module 908, a toggle control 951 forturning on and off the video of the user 950, and for increased clarity,text messages can be sent to the representative using text box 946 andsend key 947. Toggle control 951 can help ensure privacy of the user ofelectronic device 901 by turning the video capabilities of electronicdevice 901 off and on. The toggle control 951 can also be enabled toblur the user's face or cover it with a color or image. The option totoggle on or off a video stream, blur faces, or cover faces with a coloror image can also be enable by a representative of a target location.The representative of a target location can protect the privacy of thepatrons of a target location by blurring or covering the patron's facesin the video stream. This can ensure all patrons' privacy rights areprotected. While video chatting with a representative of a targetlocation, the representative can display to the user a product for sale(for example a shoe). A virtual icon 928 can be overlaid the actualproduct being displayed by the representative. If an icon 928 isselected an information box 935 can be displayed with, adjacent to, ontop of, overlaid, or in place of the product being displayed (forexample, the Super New Classic icon 928 is selected and information box935 is displayed as a pop-up box on top of Super New Classic icon 928via UI 920). The information box 935 can include the available sizes,the cost or any information that would be relevant to the product beingdisplayed.

FIG. 10 illustrates a UI 1020 configured for display on an electronicdevice 1001 when the bar feed 632 from non-interactive video 631 isselected from the UI illustrated in FIG. 6. FIG. 10 shows a live videofeed of the bar from a static camera located in Leroy's. In anotherexample the camera could be located in any location in any type oftarget location: conference, stadium, top of skyscraper, or inside astore. The user is currently viewing the bar video feed 1043 (which ishighlighted), but can also switch to different video feeds in the venueby using touchscreen 1054 (for example, the user can select differentvideo feeds from the non-interactive video menu 1031, such as, diningroom 1032, waiting area 1032, or kitchen 1032). UI 1020 can also includea communications menu 1033. The communication menu 1033 can includeoptions or video and non-video communication (for example, video chat ortelephone call). By selecting a specific individual 1034 to communicatewith the user is then audio and visually connected to that specificindividual, (for example, if the user selected Maitre'd 1034, they couldask about the dress code of the target location or to get their name ona waiting list). The information associated with the target location canalso include live statistical information 1036. For example, livestatistical information can include average wait time and seatingavailability. The live statistical information can be updated inreal-time. In FIG. 10, the live statistical information 1036 canindicate that Leroy's is currently has eight available seats for lunchand seven open seats at the bar. Based on such information, the user canrequest, via the user's electronic device, a reservation of a seat forlunch. The availability of seats can be determined by linking orsynchronizing a computer system associated with the target location andthe internet or a server that communicatively couples the user'selectronic device and the target location)

The aforementioned disclosure offers the user information via real-timeexperiences at the locations of their choice. Experiencing a locationremotely provides the user with something more than just arecommendation or someone else's opinion of, it provides the comfort ofknowing you'll get the experience you desire when choosing to go to thatspecific restaurant, bar, clothing store, shoe store, consumer marketplace, or any other location.

As discussed above, the various embodiments can be implemented in a widevariety of operating environments, which in some cases can include oneor more user computers, computing devices, or processing devices whichcan be used to operate any of a number of applications. User or clientdevices can include any of a number of general purpose personalcomputers, such as desktop or laptop computers running a standardoperating system, as well as cellular, wireless, and handheld devicesrunning mobile software and capable of supporting a number of networkingand messaging protocols. Such a system also can include a number ofworkstations running any of a variety of commercially-availableoperating systems and other known applications for purposes such asdevelopment and database management. These devices also can includeother electronic devices, such as dummy terminals, thin-clients, gamingsystems, and other devices capable of communicating via a network.

Various aspects also can be implemented as part of at least one serviceor Web service, such as part of a service-oriented architecture.Services such as Web services can communicate using any appropriate typeof messaging, such as by using messages in extensible markup language(XML) format and exchanged using an appropriate protocol such as SOAP(derived from the “Simple Object Access Protocol”). Processes providedor executed by such services can be written in any appropriate language,such as the Web Services Description Language (WSDL). Using a languagesuch as WSDL allows for functionality such as the automated generationof client-side code in various SOAP frameworks.

Most embodiments utilize at least one network that would be familiar tothose skilled in the art for supporting communications using any of avariety of commercially-available protocols, such as TCP/IP, OSI, FTP,UPnP, NFS, CIFS, and AppleTalk. The network can be, for example, a localarea network, a wide-area network, a virtual private network, theInternet, an intranet, an extranet, a public switched telephone network,an infrared network, a wireless network, and any combination thereof.

In embodiments utilizing a Web server, the Web server can run any of avariety of server or mid-tier applications, including HTTP servers, FTPservers, CGI servers, data servers, Java servers, and businessapplication servers. The server(s) also can be capable of executingprograms or scripts in response requests from user devices, such as byexecuting one or more Web applications that can be implemented as one ormore scripts or programs written in any programming language, such asJava®, C, C# or C++, or any scripting language, such as Perl, Python, orTCL, as well as combinations thereof. The server(s) can also includedatabase servers, including without limitation those commerciallyavailable from Oracle®, Microsoft®, Sybase®, and IBM®.

The environment can include a variety of data stores and other memoryand storage media as discussed above. These can reside in a variety oflocations, such as on a storage medium local to (and/or resident in) oneor more of the computers or remote from any or all of the computersacross the network. In a particular set of embodiments, the informationcan reside in a storage-area network (“SAN”) familiar to those skilledin the art. Similarly, any necessary files for performing the functionsattributed to the computers, servers, or other network devices can bestored locally and/or remotely, as appropriate. Where a system includescomputerized devices, each such device can include hardware elementsthat can be electrically coupled via a bus, the elements including, forexample, at least one central processing unit (CPU), at least one inputdevice (e.g., a mouse, keyboard, controller, touch screen, or keypad),and at least one output device (e.g., a display device, printer, orspeaker). Such a system can also include one or more storage devices,such as disk drives, optical storage devices, and solid-state storagedevices such as random access memory (“RAM”) or read-only memory(“ROM”), as well as removable media devices, memory cards, flash cards,etc.

Such devices also can include a computer-readable storage media reader,a communications device (e.g., a modem, a network card (wireless orwired), an infrared communication device, etc.), and working memory asdescribed above. The computer-readable storage media reader can beconnected with, or configured to receive, a computer-readable storagemedium, representing remote, local, fixed, and/or removable storagedevices as well as storage media for temporarily and/or more permanentlycontaining, storing, transmitting, and retrieving computer-readableinformation. The system and various devices also typically will includea number of software applications, modules, services, or other elementslocated within at least one working memory device, including anoperating system and application programs, such as a client applicationor Web browser. It should be appreciated that alternate embodiments canhave numerous variations from that described above. For example,customized hardware might also be used and/or particular elements mightbe implemented in hardware, software (including portable software, suchas applets), or both. Further, connection to other computing devicessuch as network input/output devices can be employed.

Storage media and computer readable media for containing code, orportions of code, can include any appropriate media known or used in theart, including storage media and communication media, such as but notlimited to volatile and non-volatile, removable and non-removable mediaimplemented in any method or technology for storage and/or transmissionof information such as computer readable instructions, data structures,program modules, or other data, including RAM, ROM, EEPROM, flash memoryor other memory technology, CD-ROM, digital versatile disk (DVD) orother optical storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or any other medium which canbe used to store the desired information and which can be accessed by asystem device.

Embodiments of the present disclosure can be provided as a computerprogram product including a non-transitory machine-readable storagemedium having stored thereon instructions (in compressed or uncompressedform) that can be used to program a computer (or other electronicdevice) to perform processes or methods described herein. Themachine-readable storage medium can include, but is not limited to, harddrives, floppy diskettes, optical disks, CD-ROMs, DVDs, read-onlymemories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, flashmemory, magnetic or optical cards, solid-state memory devices, or othertypes of media/machine-readable medium suitable for storing electronicinstructions. Further, embodiments can also be provided as a computerprogram product including a transitory machine-readable signal (incompressed or uncompressed form). Examples of machine-readable signals,whether modulated using a carrier or not, include, but are not limitedto, signals that a computer system or machine hosting or running acomputer program can be configured to access, including signalsdownloaded through the Internet or other networks. For example,distribution of software can be via Internet download.

Based on the disclosure and teachings provided herein, it will beunderstood that other ways and methods of implementing the variousembodiments described above are possible. The specification and drawingsare illustrative and are not to be construed as limiting the scope ofthe following claims.

1. A computer-implemented method for providing an interaction between anelectronic device and a target location comprising: receiving, at aserver from the electronic device, an identification of a targetlocation; transmitting a request, from the server to the targetlocation, for a video feed associated with the target location;receiving, at the server, the video feed; and transmitting, from theserver to the electronic device, the video feed.